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By Vlada Limic 1 and Pierre Tarres 2 

CNRS, Universite de Provence and Oxford University 

The goal is to show that an edge-reinforced random walk on 
a graph of bounded degree, with reinforcement weight function W 
taken from a general class of reciprocally summable reinforcement 
weight functions, traverses a random attracting edge at all large 
times. 
P^ ' The statement of the main theorem is very close to settling a 



conjecture of Sellke [Technical Report 94-26 (1994) Purdue Univ.]. An 
important corollary of this main result says that if W is reciprocally 
summable and nondecreasing, the attracting edge exists on any graph 
of bounded degree, with probability 1. Another corollary is the main 
theorem of Limic [Ann. Probab. 31 (2003) 1615-1654], where the class 
of weights was restricted to reciprocally summable powers. 

The proof uses martingale and other techniques developed by the 
authors in separate studies of edge- and vertex-reinforced walks [Ann. 
q I Probab. 31 (2003) 1615-1654, Ann. Probab. 32 (2004) 2650-2701] and 

pvj ■ of nonconvergence properties of stochastic algorithms toward unsta- 

^+ ' ble equilibrium points of the associated deterministic dynamics [C. 

O ! R- Acad - Set. Ser. I Math. 330 (2000) 125-130]. 

\D 
O 



1. Introduction. Consider a connected graph Q with the set of vertices 
V = V{Q) and the set of (unoriented) edges E = E{Q). The only assumption 
on the graph is that each vertex has at most D{Q) adjacent vertices (edges) 
for some D(Q) < oo. So the graph Q is either finite, or infinite with bounded 
degree. Special cases are infinite lattices. 

Call two vertices v, v' adjacent (v ~ v' in symbols) if there exists an edge, 
denoted by {v, v'} = {v',v}, connecting them. For vertex v of Q, let A(v ) C V 



denote the set of adjacent vertices v' 



r\; 



v. 
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2 V. LIMIC AND P. TARRES 

Let W(k) > 0, k > 1, be the weight function. The edge-reinforced random 
walk on Q records a random motion of a particle along the vertices of Q with 
the following properties: 

(i) if currently at vertex v £ Q, in the next step, the particle jumps to a 
vertex in A(v); 

(ii) the probability of a jump to v' is W -proportional to the number of 
previous traversals of the edge {v ,v'}. 

More precisely, let the initial edge weights be Xq £ N for all e £ E. We 
assume throughout the paper that sup 6 Xq < oo. 

Let I n be a V- valued random variable, recording the position of the parti- 
cle at time n, n > 0. For concreteness, set Iq = vq for some ^o £ V. A traversal 
of edge e occurs at time n + 1 if e = {/ n , I n +i}- Denote by A^ — Xq the to- 
tal number of traversals of edge e until time n. Let J- n be the filtration 
<r{(/ fc ,Xf ,e £ E),k = 0,...,n} = a{I k ,k = 0, . . . ,n, (X e ,e £ £)}. 

The edge-reinforced random walk on (/ with weight function W is a Markov 
chain (I,X) = {(I n ,X^,e£ E),n> 0} on state space V{Q) x N £ with the 
following conditional transition probabilities: on the event {I n = v}, for 
v' e A(v), 

w(xh v ' v '}) 

P(I n +l =v', Xn + i=Xn + t{e={v,v>}},e<EG\T n ) = — {v,w}\ ' 

(1) 

It is easily seen that the edge-reinforced random walk is well defined for 
any weight function W, where W(k) > 0, k £ N. Let (HO) be the following 
condition on W: 

Let us make a few preliminary observations. A simple calculation shows 
that (HO) is the necessary and sufficient condition for 

P({I n , I n+1 } = {I , h} for all n) > 0, 

so that an attracting edge exists with positive probability. This implies that 
(HO) is necessary and sufficient to have 

P(walk is attracted to a single edge) > 0, 

and a variation of the above argument also implies that 

P(walk is attracted to a finite subgraph) = 1. 

However, it can easily be shown that if J2k 1/W"(fc) = oo and W is nonde- 
creasing, then any edge adjacent to an edge traversed by the walk infinitely 
often must also be traversed infinitely often. 
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The case Q = Z has been studied by Davis in [1], who has proven that 
if (HO) does not hold and W is nondecr easing, then, with probability 1, 
every vertex in Z is visited by the walk infinitely often, that is, the walk 
is recurrent. This statement has, in fact, no proven general counterpart for 
other infinite graphs: even the original recurrence/transience question raised 
by Coppersmith and Diaconis [2] in 1986 for W linear and Q = Z d , d > 2, is 
still open. For recent results on linearly ERRW, see [4, 6]. Sellke [7] provided 
examples of W not nondecreasing and not satisfying the condition (HO) such 
that for the corresponding reinforced walk, an attractor consisting of two or 
more edges exists with positive (or full) probability on Z, as well as on other 
graphs. 

In the case where (HO) holds, the first result is due to Davis [1], who 
proved that on Z, there exists almost surely some random integer i such 
that the walk visits only i and i + 1 at all large times. Sellke [7] generalized 
this statement and showed that, if Q = Z d , d > 1, then under the necessary 
assumption (HO) (without any monotonicity requirement), there exists al- 
most surely some random attracting edge, which is traversed by the walk at 
all large times. The same paper contains the conjecture that the above prop- 
erty holds for edge-reinforced random walks on general graphs of bounded 
degree. 

The argument developed by Sellke [7] carries over to the setting where Q 
is any graph of bounded degree without odd cycles, a fact used by Limic [3]. 

In [3], it was proven that on any graph of bounded degree, the attracting 
edge exists with probability 1 if W(k) = k p for p > 1. In this paper, we 
show a generalization of this result to a large class of weight functions W, 
including the class of nondecreasing weights satisfying (HO), making use of 
the techniques developed by the authors in [3, 8] and [9]. 

A cycle C in Q of length \C\ is a subgraph of Q spanned by a |C|-tuple of ver- 
tices (v±,V2,---,v\c\), such that {vi,v i+1 } G E, i = 1, . . . , \C\ - 1, {v\ C \,vi} £ 
E, and Vi ^ Vj if i ^ j. 



For each n G N, let 



a, 



x- 1 



1 1 



E 

k=n+l 



W(k) W(k-l) 



Let 



v{Q) := sup y/2\G'\ 

Q'dQ odd cycle 



with the convention that v(Q) = if there are no odd cycles. Note that if 
there are odd cycles of arbitrarily large length in Q, then v(Q) = oo. 
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Let (HI) be the following condition: 

(HI) i/(a)liminf-^=<l, 

lou, 



with the convention that oox0 = 0xoo = [i.e., if the liminf is 0, then the 
condition (HI) is satisfied for any graph Q; if v{Q) = 0, then (HI) is satisfied 
for any value of the lim inf ] . 
Let 

Goo = \ e G E : supX^ = oo 

be the (random) graph spanned by all edges in Q that are traversed by the 
walk infinitely often. Note that 

{£oo has only one edge} = {3N < oo s.t. {I n ,I n +i} = {InJn-i} Vn > N} 



3e G E such that sup sup X^ < oo >. 

e'^e n J 

The main result of this paper is the following theorem. 

Theorem 1. If W satisfies (HO) and (HI), then the edge-reinforced 
random walk on Q traverses a random attracting edge at all large times a.s., 
that is, 

(2) P{Qoo has only one edge) = 1. 

Theorem 1 is proven in Section 2. It implies, in particular, that if W is 
nondecreasing and (HO) holds, then Q^ has only one edge almost surely. 
This statement is shown in Corollary 3 below, based on the observation that 
if (HI) does not hold and W is nondecreasing, then W belongs to a fairly 
large class of weights (affectionately called the sticky weights), given by the 
condition 

(H2) liminf ( max W(j) ) V „„.,. < oo, 

v ; n->oo \o<j<n J ^ n W(k) 

for which the attracting edge property is shown in Lemma 2 below. Another 
consequence of Theorem 1 is stated and proved at the end of this section in 
Corollary 4. 

Lemma 2. (Wl) implies (2). 

Proof. Denote the finite liminf from (H2) by I and let M = {n > 1 : 
(maxo<j<n W(j)) Y^k>n w]k) < ^ + !}• Then, clearly, N is an infinite set. Fix 
m G M and let the ERRW (I.,X.) run until the time 



J m := inf < k > 1 : there exists an edge e such that X% = m, max X% < m 
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at which one edge has been traversed m times (where we take into account 
the initial number of visits Xq to the edge) and all others have been traversed 
strictly fewer times. Note that the stopping time J m is a.s. finite for any 
m > sup eeE XQ. Indeed, as long as all of the edges have been visited at most 
771—1 times, the probability transitions of the random walk depend only on 
the values of W on the set {1, ... ,771 — 1} and are therefore bounded both 
below and above by positive and finite constants. Hence, for any n < 00, 
given J- n Aj m (here and later "A" denotes the minimum operator), and on 
the event {n < J m }, the probability that any particular edge e G E adjacent 
to the current position I n will be traversed back and forth from time n 
until the moment its corresponding number of traversals Xf reaches value 
777 is bounded below by a positive constant. This implies J m < 00 a.s. by the 
conditional Borel-Cantelli lemma. 

Take m > sup ee£; XQ and denote by ej m the edge e such that Xj = m. 
Set d = D(Q) < 00 and note that the probability that from time J m onward 
the walk traverses only edge ej m is bounded below by 



^ T^(t77 + A:) 



(3) 



k- 



f W(m + k) + dmax.j <m W(j) 

tt / 1 _ d max.,- <m W (j ) 



W(m + k) + dmax j<m W(j) . 
which is, uniformly in m£j\f, bounded away from since 

(4) V rpax j<m W(J) </ + 1 

^ W(m + k) + dmax j<m W(j) 

Therefore, there exists c > such that, for all 777 G jV, 

^(l{attracting edge exists} KJm) > C > 0. 

Now, {J-j m , 777 G M) is a filtration with the natural ordering of elements of A/", 
and {attracting edge exists} is contained in the limiting a-field lim^^j = 
lim m ^ 00irne ^/-JFj m . Here, we use the fact that J m are strictly increasing in 
777, almost surely. Therefore, the Levy 0-1 law implies that an attracting 
edge must exist with probability 1. □ 

Corollary 3. Assume that W is nondecreasing and that (HO) holds. 
Then Goo has one edge almost surely. 

Proof. If W is nondecreasing, then 5 n = 1/W(n). Recall that (HO) 
implies S n — > as 77 — >• 00. Let us prove that if liminf 5 n / yfa^ > 0, then 

(5) limsupH^n)^— — < 00, 

n-00 k>n w W 
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implying (H2), so that an attracting edge exists almost surely by Lemma 2. 
This will complete the proof of the corollary since liminf 5 n /y/a^ = would 
imply (HI). 

Using the fact that liminf <5 n /- v /o^ > 0, there exists e > such that for 
n>nQ, 

1 °° 1 

>-E 

k=n 



W{nf'-^W(kf 



This implies, for all n > no, that 



1 



W{n 



k=n 



1 

W{kf 



^Etfth^EE 



k>nj>k 



W{jf 



E 
> r 3 v v J ~ n + 1 > ^_sr( k ~ n + 1 ) 2 

- 2^2-, T/WM2 - 9 Z^ 



.2^i-" + 1 



WW 



^(fc) 2 " 2 . 



W(fc) 5 



Using the Cauchy-Schwarz inequality, for all n > no, 



1 



A; — n+ 1 



1 



^ W(Jfe) ,V W(Jb) fc - n + 1 

fc>n v ' k>n v ' 



< 



\ 



E 



(k-n + 1) 5 



E 



1 



< 



1 

J 



n + 1) 2 



^6 V e 3 W(n) 



which yields (5). □ 



Remark. Note that no assumption on v{Q) is needed in the result 
above, nor in the next result. 



Let, for all n > 2, 

W'(n) :=W(n) -W(n - 1). 
Let (H3) be the following condition: 



(H3) 



fW'(n)\ 2 



n>2 



Corollary 4. Assume that (HO) and (H3) hold. Then Q^ has only 
one edge almost surely. 
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Proof. It suffices to prove that (H3) implies (HI). Suppose (H3). Then 
there exists A e M+ such that for all n > 2, W(n — 1) > AW{n) [using the 
fact that W(n - l)/W{n) -> 1 as n -> oo, by (H3)] and 



= E 

k>n 

<A- ] 



1 



W(ife) W(lfe-l) 



1) " ^ W(k) 2 



kTn' w 



k>n 



k\w(k)J 



\ k>n 



\ 



k>n 



1 



H/(/fc) s 



\/o^ ^4 



-i 



\ 






by the Cauchy-Schwarz inequality in the last line. 

This last inequality yields, together with (H3), that limsup<5 n /- v /o^ = 0, 
which implies (HI). □ 

Remark. Let us give two examples of a reciprocally summable weight 
for which we still do not know whether or not an attracting edge exists almost 
surely, on graphs with at least one odd cycle. Let W(k) := k 1+p /(2 + (— l) fc ). 
Then 8 n ~ n ^oo 2p~ 1 n~ p and ^Ja^ = 0(n _(p+1/2) ), so that (HI) is not sat- 
isfied. Assumption (H2) is not satisfied either since J2k>n 1/W(k) ~ n ^oo 
2p~ l n~ (J . Similarly, W{k) = exp{fc(2 + ( — 1) )}, constructed from two weights 
satisfying hypothesis (H2) does not satisfy it anymore; nor does it satisfy 
(HI) — whenever Q contains an odd cycle — since 5 n and y / a^ are then of the 
same order asymptotically. 



2. Proof of Theorem 1. This section is devoted to the proof of Theo- 
rem 1. The following proposition follows from results of [3] and [7]. 

Proposition 5. Assume that (^HOj holds. Then, almost surely, Goo is 
either a cycle of odd length or a single edge. 

Proof. The arguments of Section 2 in [3] apply here verbatim, but for 
the benefit of the reader, we provide more details. Recall that we assume 
throughout the paper that each vertex has at most D(Q) adjacent vertices 
for some D(Q) < oo, that is, that the graph is of bounded degree. Define 
by Q\ the subgraph of Q spanned by the edges visited at least once by the 
walk. We know from [7], Lemma 4, that Qx, and therefore Goo, is a finite 
graph. First, [7], Theorem 3 (alternatively, [3], Lemma 1), shows that there 
is a.s. no even cycle contained in Qoa and that if £/oo is a tree, it a.s. only 
consists of two vertices and one edge connecting them. Second, [3], Lemma 
2, says that there is at most one odd cycle contained in Qoo, almost surely. 
Third, [3], Corollary 1, says that with probability 1, Qoo contains no vertex of 
degree > 3. Therefore, with probability 1, either Qoo contains an odd cycle, 
in which case it is exactly equal to this cycle, or it is a single edge. □ 
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Now, the event {Goo is an odd cycle} is a union of at most countably 
many events 

(6) {£/oo is an odd cycle C}, 

where C is any fixed odd cycle in Q. Therefore, it suffices to prove that each 
event above happens with probability 0. Moreover, as observed in [3], if the 
edge-reinforced random walk on Q stays within a finite cycle C of length £ 
starting from some time no, at which the current edge weights on the edges 
of C are given by z\, . . . ,Z£, then its transition probabilities starting from 
time no (and therefore its law, and asymptotic behavior) are identical to 
those of the edge-reinforced random walk on the cycle of length £ started 
from the initial configuration of edge weights z\, . . . , Zj>. Since the event in 
(6) is a countable union over all finite times no and all finite configurations 
zi,...,Z£, it is sufficient to prove the following proposition. 

Proposition 6. Let Q be a cycle of length £, where £ is an odd number. 
Assume that (HO) holds and that 

liminf — — = < 



"-* 00 V^ y/2\G\ \[2£ 
Then for any choice of initial condition Xq £N,e£E, we have 

(7) P(Goo = Q) = 0. 

Remark. For the sake of concreteness (and brevity of notation), we 
provide the proof of this result for the initial condition Xq = 1 . We remark 
in Section 2.3 how the proof easily extends to the general initial condition 
setting. 

Therefore, we assume in the sequel that Q := Z/£Z, with £ odd, without 
loss of generality. 

This section is divided into three parts: in 2.1 we introduce the processes of 
interest and justify them, in 2.2 we prove preliminary estimates and results, 
and sketch the proof of Proposition 6, which is given in 2.3. 

2.1. Preliminary notation and intuition. For all n S N, let H^*(0) = 
and 
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For all n G N and x G Z/£Z, let 



^ /"$-{I k -i=x,Ik=x+l} 1 {h-i=x+l,I k =x} 



{x) "ts w{xtr l} ) w{xtr l \ 

/ \ V^ / -"-{J fc _i=x,J fc =x+l} _ -"-{/ fc _i=x,J fc =a:-l} 

n{ h ~tA wixir^) ^(4!'r 1} ) 

/ n _ yV 1L {{4-i,4}={^+i}} i {{/ fc -i,4}={x-,x-i}} \ 

KnW " ,eA ^(4!'r i} ) ^(4!r l} ) / 

= w*{x^ x+1 ^ - 1) - w*^'* -1 * - 1). 

Let us make the following observations, in order to justify the definitions of 
the above processes. First, note that under (HO), all of the above processes, 
being differences of nondecreasing bounded sequences, are bounded and have 
random finite limits as n — > oo. Fix x G TLjlTL. The process k.(x) is a useful 
way to keep track of the changes due to repeated visits of the random walk 
to the two edges {x,x — 1} and {x,x + 1}. In particular, 

(8) (supXf*'*- 1 } = supX^' x+1 > = oo) C ( lim K n (x) = 

ln>l n>l J [n->oo 

so knowing that, almost surely, Koo( x ) = hnin^oo K n (x) 7^ for at least one 
x G Z/^Z would be sufficient to conclude (7). The proof of Proposition 6 
relies on this observation. 

The process e.(x) is analytically the nicest of the three since it is a mar- 
tingale. 

Lemma 7. For each x G Z/£Z, the process (e n (x)) ng N is o, martingale. 

Proof. Given x G Z/^Z, (e n (a ; ))neN is a martingale since for all n G N, 
e n+ i(x) = e n (x) if I n ^ x and if I n = x, then 

E(e n+ i(x) -E n (x)\F n ) 

w{xt x+l} ) 1 



w(xt x+1} ) + w(xt ,x ~ 1} ) w(xt ,x+1} ) 

w(xt x ~ 1} ) 1 

w{xt x ~ l] ) + w{xt x+1] ) w{xt x ~ l] ) ' n 

Note that e.(x) only captures half of the traversals of edges {x, x + 1} and 
{x, a; — 1}, namely those originating from the central vertex x. 
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Process C-( x ) is a measure of difference in the directional visits to edge 
{x, x + 1}. Clearly, 

n -n n n 

E JL {{Jfc_i,J fc }={x,x+l}} _ 9 V^ -"-{J fc -i=a;,Jfc=a;+l} _ . / v 



fc=l ^(^fc-l 



- w(4T 1} : 



and, similarly, 



%-iAHv-i}} .ov 1 

{x,a;— 1} 



£ 



fc=l H / (,A fc _ 1 J 



A useful relation follows: 

(9) K n (x)=2£ n (x)-( n (x)-( n (x-l). 

Moreover, note that for all n £ N, 

(10) E (Cn(z) -£„(*)) = 



.ft 



since 



71 / -rl -rl 

{) {) ~tA w{xtr 1} ) " w(xtr 1} ) 

which implies that 

J2 {Cn(x) - e n {x)) 



xez/a 



l[4_i=a! ) i*=x-l} 



xcz/izk=i W{X k _ x ) xez/mk=i vv {x k _ l j 



E E 



i{/ fe _i=x+l,/ fe =x} 



n 11 n 11 

EV^ iL {Ik-i=x,I k =x~l} _ \r^ y^ u -{I k - 1 =x,I k =x- 
^— ^ rrr/ „{x,i-l}> A_^ Z_^ 



k=ixez/iz W{X k 2 x ) 



0. 



let 



Recall that <5 n = J2T=n+i I WTfcT ~~ wtl-i) I ■ ^ or all A;, n G N such that n> k, 
Sk,n(x) := 5 { X , x +i} - 6 y {x, x +i} , if k < n< oo, 



5fc,oo(^) := ^-o.^+i} 



^ 



Afc, n := ^2 $k,n(%), 



if fc < oo, 
if k < n < oo. 



,rt 



Note that 
(11) 



1 



W(X { k x ' x+1} ) 



< E 



._ Y {x,x+l} 
J—^k 



1 



1 



W(j) W(j + 1) 



£fc,. 



STRONGLY EDGE REINFORCED WALKS 11 

Fix m£N. For all n G N U {00} and x G Z/tZ, let X* be the number of 
times the vertex x has been visited during time interval [m, n] : 

n 

X n : = J2 1 {h=x}- 
k=m 

Remark. Recall that for e G £, X^ is the number of times plus Xq that 
edge e has been visited up to and including time n. The new notation will 
not cause confusion since edges will be always denoted either by letters e, / 
or sets {•, •}. 

For each n G N U {00} and x G Z./IZ, let t n (x) (that also depends on m 
fixed above) be the time of nth visit to x during interval [m,oo]: 

t n (x) := inf{/c > m:X% = n} = inf{fc > t„_i(x) : 1^ = x}. 

Note that t n (x) may take the value 00 (if X% < n,\/k) and then tj(x) = 00 
for all j > n. However, if t n (x) < 00, then t n+ i(x) > t n (x), almost surely. 

In the proof, we will focus on one particular vertex of the cycle, adjacent 
to the least-visited edge at some particular time. We will suppose it is vertex 
for simplicity and let 

K n := K n {(j), t n := t n [[j). 

Note that 

= E(p(g OQ ^g\F tn )\F m ) 

(12) 

= E(p(a oc ± g\F tn )t {tn =oo} + nQoo + G\Ft n )t {tn<O0] \F m ) 

> P{t n = oo\F m )+E(E(t {goom \F tn )t {tn<oo} \f m ). 

We will provide a uniform lower bound 

( 13 ) E ( 1 {Goo^S}\ :F t n )t {tn<oo} > c± {tn<oo} 

for some c > 0, for all n G N sufficiently large [cf. discussion preceding (26)]. 
This will imply that 

P(Qoc + Q\?m) > P(tn = 00 1 T m ) + (1 " P(tn = Oo|^ m ))c > C 

for all m sufficiently large, and the Levy 0-1 law will imply (7). 
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2.2. Preliminary results. The proof of Proposition 6 is based on a study 
of the behavior of n n {x), x G Z/^Z. We prove in Section 2.3 that there exists 
a.s. x G Z/£Z such that n n (x) does not converge to 0, which enables one to 
conclude that, almost surely, either {x,x + l} or {x,x— 1} is visited finitely 
often [otherwise, Koo(x) = 0]. 

Given x G Z/£Z, the process {n n (x)) n >o, contrary to (e n (x)) n >Q, is not a 
martingale. Our first aim is therefore to estimate its mean behavior. Note 
that if £ were even, we would be able to answer the question without such 
an estimate, by the construction of a martingale (R n (x)) n >o combining the 
processes (n n (x)) n >o, x G Z/£Z: 

Rn(x):= Yl K n(x)= Y. (-l) X £n(x). 

x£Z/a,x even zeZ/« 

Then an upper bound of the variance of the increments would enable us to 
prove that R n (x) a.s. does not converge to 0, which subsequently implies 
that there is at least one x G Z/£Z such that n n (x) does not converge to 0, 
as required. Sellke [7] obtains the corresponding result (for £ even) using a 
construction due to Rubin. 

The behavior of (n n (x)) n eN is described by equation (9): 

K n {x) = 2e n (x) - Cn(x) - (n(x ~ 1), 

where ( n (y), y £ Z/ZZ, defined in Section 2.1, is the difference between the 
weighted numbers of visits from y to y + 1 and those from y + 1 to y. Hence, 
the study of n n (x) requires [through Q n (x) and ( n (x — 1)] some information 
on the probabilities of cycles 

q n := P({I tn +i = 1} n {h n+1 -i = -1 or t n+1 = oo}|^ n ), 

On ■= P({Itn+l = "I} n {^n+1-1 = 1 OT Wl = 00}\T tn ). 

The quantity q n defined here is the probability of a cycle from the right 
(from to 1 and then returning by —1), whereas q n is the probability of 
a cycle from the left (from to —1 and then return to by 1). 

A natural method to compare q n and q n would be to write them explicitly 
for each possible path and then to find a coupling of the corresponding paths 
with reversed paths, as done in [3] for W(n) = n p , p> 1. But this method is 
difficult to apply since the estimates depend on the regularity of W, as well 
as on the current numbers of visits to the edges. 

We relate the quantities q n and q n using the two following observations: 

(i) for any x G Z/£Z, E(£ in+1 (x) — Cuix)^^) provides a good estimate of 

{q n ~ Qn)/W(X^' x+li ), provided ^t n ,t n+1 {x)\T tn ) is small [see Lemma 8(i) 
and (ii)]; 

(ii) J2xez/aCn{x) is a martingale [Lemma 7 and equation (10)]. 
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Therefore, since all of these estimates of E(£ in+1 (x) — Q n (x) \Ft n ) have the 
sign of q n — q n and sum to zero, q n — q n is negligible and (Kt„)neN is close 
to a martingale with respect to filtration (J-t n )neN [ see Lemma 8(iv)]. Here, 
we also need the fact that under assumption (HI), ~^{o~t n ,t n+1 {x)\J : t n ) can be 
neglected for any x G Z/£Z. 

The link between E(Ct n+1 (x) - tt n {x)\f tn ) and (q n - q n )/W{X^ x+1} ) 
described above is a consequence of the fact that the evolution Ct„+i ( x ) ~ 
(t„(x) is only significant over the excursions (t n ,t n+ i) away from which are 

cycles, where it increases (resp., decreases) by 1/W(X^' X ) if the cycle is 
from the right (resp., from the left), while during the excursions which are 
not cycles (this happens whenever i"t»+i = It n+1 ~i), for each x, the traversals 
of an edge {x,x + 1} contribute as many times positively as negatively to 
the evolution of C-( x ). 

The property that (ftt n ) n eN is close to a martingale enables one to control 
the evolution of k% (Lemma 10) and to prove (in Section 2.3) that Kt n does 
not converge to with lower bounded probability if {0, 1} is at some point 
traversed fewer times than the other edges {x,x + 1}, i^O. 

For all x G Z/£Z, let us define the (^ r t n ) n >2-adapted processes (u n (x)) n >2, 
(An)n>2, (K(x)) n >2 and (v n ) n > 2 by 

Un(x) := Ct n (x) - Ct n ^( x ) 

1 { / 'n-l + l= 1 } n { / *n-l=- 1 ° r *n= °} ~~ ^{h n _ 1 + l=-l}n{I tn -l = l Or t n =Oo} 



(14) 



A n 



w(xtT 1} ) 



xez/ez W(X tn ' 



(15) K{x) ^jm$^!i €i0A) 



An 



'■>n-= Yl (Vl(0)+A„-i(-l) - 1x6(0,-1} )«n ^ 



and 



x£ 

The processes (u n (x)) n >2 and (v n ) n >2 play an important role, as made 
explicit in the following lemma: M(v n +i\J-t n ) is the drift increment of Kt„ +1 — 
Kt n [Lemma 8(iii)] and u n (x) and v n +i [which is a weighted sum of u.„+i(x), 
x G Z/£Z] are small, by Lemma 8(ii), |u n (^)| < ^t n -i,tn( x )- Recall that we 
concentrate here on the behavior of the process K n = K n (0). 

Lemma 8. For all x G Z/£Z and n G N, a.s. on {t n < oo}; 
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(i) E(C tn+1 (x) - Ctjx) - u n+1 (x)\r tn ) = — f^TTTT, 

w ( x t„ > 
(ii) \u n+1 (x)\ < S tn> t n+1 (x), \v n+ i\ < A tn>tn+1 , 

(iii) E(/ct n+1 - K tn - v n+ i\F tn ) = 0, 

(iv) |E( Kfn+1 -KtJ^iJI <E(A tnA+1 |^J. 

Proof. Property (i) follows directly from definition (14). 
Let us prove property (ii): Assume that t n < oo and note that by symme- 
try, it suffices to consider the case h n +i = 1- We then have 

X t \, - 1 l. y{x,x+l} 

since during the time interval (i n , £ n +i) , there are X^f^ — X^' x (possi- 
bly infinitely many) traversals of the edge {x, x + 1} in alternating directions 
and since the first traversal (if there is one) happens in the direction of the 
directed edge (x,x + l). 

Assume first that, in addition, t n+ \ < oo. Now, either It n+1 -i = h n +i = 1 
or L , n _i = —1. In the former case, there is an even number of summands 
in (16) with alternating signs for each x, and, clearly, 

\u n +i(x)\ = |Ci„+i(^) - (t n (x)\ < 5 tnitn+1 (x). 

In the latter case, (16) consists of an odd number of terms and, similarly, 

(17) \u n+1 (x)\ = |C*„ +1 (x) - ( tn (x) - l/W(X%> x+1} )\ < S tn , tn+1 (x). 

Next, assume that £ n _|_i = oo. Then there exists yj^O such that {y, y + 1} 
becomes the attracting edge during the "uncompleted excursion" [t n ,oo). 
The reasoning is very similar to the one above. Namely, if x < y, then the 
sum in (16) consists of an odd number of alternating terms and, again, an 
estimate (17) applies. If x > y, then (16) has an even number of terms and we 
use estimate (11) to derive (17). If x = y, then (16) is an infinite alternating 
sum, so the reasoning from the t n+ \ < oo case applies. 

To bound v n+ i, use the fact that A n (0) + A n (— 1) G [0,1] and conclude 
that 

K+l|< Yl \ u n+l(x)\< Yl $t n ,t n+1 (x) = A tnttn+1 . 



Let us now prove (iii): for all x € Z/£Z, (e n (x)) n6 N are martingales and 
equation (10) holds, therefore (J2xez/a Cn (^))nGN is a martingale. This im- 
plies, summing (i) over x € Z/£Z, that 

(Qn-q n ) E u „ Y {x,x+i} : = E EK +1 (x)|JT t J 
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or, alternatively, 

(18) 



in «n- A 



it 



Hence, property (i) for x G Z/£Z implies that on \t n < 00} , we have 
m n+ i(x)-(t n (x)\F tn )=E(u n+1 (x)\F tn )-\ n (x) E E(n n+1 (y)|^, 



= H(My=x} ~ A n (x))E(u„ +1 (y)|^J. 
2/ 

Accordingly, using (9) and Lemma 7, we conclude that on {t n < 00}, 

a;e{0,-l} 

= E (A n (0) + A n (-l)-l ie{0 ,_ 1} )E(u n+1 (.)|f ( „ 



= E[« n+ l|J 7 t n ]- 

Property (iv) follows from (ii) and (iii). □ 

Even more precise estimates of the drift of k. will be needed and the 
following technical lemma provides the necessary calculations. 

Lemma 9. (i) On {t n < 00} n {It„+i = 1}, we have 

E(«t„ +1 - K tn+ i - v n+ i\F tn+ i) = A n (0)(l - A re (0) - A„(-l))A n . 
(ii) On {t n < 00} n {It n +i = — 1}, we have 

E ( K Wi - K t n +1 ~ Un+ll^+l) = -A re (-l)(l - A n (0) - A„,(-l))A n . 

Remark. Note that Lemma 8 (iii) is a consequence of (i)-(ii) by nested 
conditioning on Ftn+i, although we preferred to give its proof independently 
for the benefit of the reader. 

Proof of Lemma 9. Let us assume that t n < 00 and h n +\ = 1, and 
prove (i). 

Let us define 

r* n : = P(/ in+1 _i = -1 or t n+1 = oo^n+l), 

^n ■= P(I tn+1 -i = 1 or t n+1 = oolFtn+i)- 
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Then by (14), for all x £ Z/IZ \ {0}, using the fact that ( tn (x) = (t n +i(x) 
and It n +i = 1, we have 

H(t n+1 (x) ~ ( tn+1 (x)\F tn+l ) =E(C W1 (X) - Ctnix^tn+l) 



= E(u n+1 (x)\T tn+1 ) + w{x {l x+1}) 
and, similarly using Ct„+i(0) = C*„(0) + 1/W(X^' 1} ), 

E(Cwi(°) " Ct n+ i(0)|^ n+1 ) = E(« n+1 (0)|jr fn+1 ) + 



^(4! ) ' 1} )' 



Again using the fact that (J2xez/aCn{x))neN is a martingale, we obtain 
£ E(C tn+1 (x)-Ct n+ i(x)|^ n+ i) 



.re 



0=r^A n +( ^ E(u n+ i(x)| < F tri +l) 

\xez/« 



Therefore, 

^= I An(0) - -f- >J E( Vl (i)|4 +1 ) 



1^(°)-t- E E ( 



a;S2 

which, by (9), implies that 
E(k*„ +1 -K^+il^tn+i) 

^ K(C Wl (x)-C i?l+ i(x)|^ n+1 ) 
xe{o,-i} 

1 - / 1 1 



^(Al°' 1} ) " W^) w(jS £,-i }) 

- ]^ E(u n+ i(x)|^i„ + i) 
xe{o,-i} 

A„(0)A n - ( A n (0) - -^ E %+iWI^+i) J (An(0) + A n (-l))A n 

- ^ E(tt n+ i(z)|J 7 t B+1 ) 

xe{o,-i} 

E ( A «(°) + ^(-i) " ^6{o,-i})E(u^-i(s)|^+i) 



.re 
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+ A n (0)A„(l-A„(0)-A n ,(-l)) 
= E[v n+1 \f tn +i] + A n (0)A n (l - A n (0) - A„(-l)). 
One can similarly show (ii). □ 



LEMMA 10. For all n G N, a.s. on {t n < oo}, 



,{0,1} 



x {o,-i}_ 1 



E(4 +1 -^J^J>E £ 



+ £ 






Tt, 



2E(|Kt, 



+ H^tn,tn+ 



ll-^trJ- 



Proof. We split 



2 2/2 2 -\ _r /- 2 2 \ 

K t n+ i K t n - \ K t n+1 K t n +l) -r \ K t n +l K tJ 

and compute the conditional expectation of each summand separately. First, 
«t n +i - «t„ = e*„+i - £tn implies that 

(19) E(K tn + 1 -Kt n \F u ) = 

and, therefore, 

E«+i - K 2 tn \T tn )=E((K tn+1 - KtJ 2 ]^) 

L{/ tn+1 =i} % tB . 



(20) 



E 



-1} 



/ 1 {Jt n +i=i} 



{0,-1}, 



^J- 



Next, we wish to estimate K(K 2 n+l — k^+iI-^O from below. Note first 
that 

2 2 

K t n+ i K t n +1 

= ( K tn+1 ~ K tn + l) 2 + 2K tn+ l(K tn + 1 ~ K tn + 1 ) 

(21) = (Kt n+1 - Ktn+l) + 2 Kt a +l(«t„+l - K tn + i - U n+1 ) + 2K tn + iU n+ i 

= k+1 - K <„ + l) 2 + 2K t„( K t n +l - K *n + 1 - V n+l) 

+ 2(Kt„+l - KtJ(« trl+1 - K t „+1 - «n+i) + 2K tn+ lV n+ i. 

Now, 

E((K Wl -K tn+ l) 2 |^tJ 



(22) 



7 |' ]1 { / tn + l- 1=1 ' t " + 1<00 } l{/t n + 1 -l=-l,i„ + l<00} 



"-(4:? 



-ij 



«"(*££i 



r,. 
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Lemma 8(iii) and identity (19) imply that 

(23) E(2K tB (K tn+1 -K tB+ i-t; n+ i)|^i B ) = 0. 

Lemma 9(i)-(ii) implies that E(«t„ +1 — «t„+i — ^n+i|-^t„+i) is positive when 
I-tn+i = 1 and negative when It n +i = — 1, hence that it has the same sign 
as kj„+i — K tn . Therefore, by nested conditioning with respect to J-"t n +l, we 
obtain that 

(24) E(2(/ct B+ i - K tn )( Ktn+1 - K tn+l - v n+l )\F tn ) > 0. 

Adding together inequalities (20), (22), (23) and (24) completes the proof, 
using the second inequality in Lemma 8(h). □ 

2.3. Proof of Proposition 6. Assume that the conditions of Proposition 6 
hold. Fix a < 1, for which the subset of N defined by 

(25) e = e a :=[neN:5 n <^^j is infinite. 



Let 



A := { min Al^i < oo j = {Q^ ± Q}. 

lx&Z/£Z J 

As remarked earlier, it suffices to prove that there exists a constant C G 
* + such that, for all m G N sufficiently large, P(A\J r m ) > C. 
Let m G N. Let, for all n G N, 

o n G argmin {X^} 



so that o n is an edge (if there is more than one edge minimizing X n , choose 
o n arbitrarily from the set of minima) corresponding to the smallest X' n . 
Note that if Xq = 1, then o n corresponds to the least-visited edge at time n. 
Define stopping time k\ = k\(m) := inf{n > m : X° n G G \ {X^ 1 }}. With- 
out loss of generality, assume that {k\ < oo} happens, since 

P{A\T m )=E{t A \^ m )=E(t A t {kl= ^ } \^ m )+E(t A t {kl<oc} \T m ) 
(26) 

= P({k 1 =oo}\f m )+E(P{A\F kl )± {kl<oo} \f m ), 

where we use the fact that is infinite and therefore {k\ = oo} C {Q ^ 
Qoo} = A. 

Without loss of generality, assume that o kl = {0, 1} and I kl =0, and note 
that we have tj- = &i, for some (random) positive integer k . 

Therefore, it suffices to find a positive lower bound on P(A\J r kl ) = 
P(A\J r t k ), on the event {k± < oo}. 
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Let 

e:=l A 



a~ l 



1 + V2' 
For all n G N, define 

e(n):=xl°> 1} AX}°>- 1} 

to be the number of traversals of the weaker (i.e., visited fewer times) edge at 
0. Note, in particular, that e{k ) = min{A^ ' 1} ,xi°'~ 1} } = X^' 1} = X^ G 
0, and that n h^ e(n) is nondecreasing, which implies, in particular, that 
n 1— > a e t n \ and n 1— ► 5 e i n \ are nonincreasing. We next state a few similar and 
easy facts for future reference. For all n>ko, 



(27) <5 e(n) < <5 e(fco) , 2A Wn+1 < 2A tfeojOC < 2^<5 e(feo) < ay / 2a e(fco) . 

Define the (J r t n )„>fc stopping time 

5:=inf{n> A; :|K in | > e^/a^Tj + A 4ni00 } 

Ainfjn > k : |Ki„_ 1+ i| > £V a e(*o) + A *fe ,oo}- 

The next three lemmas make use of the techniques developed in Lemmas 1 
and 2 in [8], and in [5]. 

Remark. To explain the technique informally, consider the martingale 
M. = Kt. — drift(Kj, ). Then the first lemma says that \M.\ infinitely often 
becomes larger than a fixed small e proportion of the total standard devia- 
tion ^/a e t.\ = SD(Moo — M.) of the (infinitely many) remaining increments 
of M; the next two lemmas say that in each situation above, there is positive 
(bounded away from 0) probability that \M.\ remains strictly above value 0, 
either by not exiting (e^/a^/2, 4^a e (.)) or by exiting it through the larger 
boundary point and not coming back to due to Doob's I? inequality. 
However, if n n — ► as n — > 00 then M n -»0asm 00. 

Remark. We prove Proposition 6 for the initial condition Xq =l,eE£, 
but the same proof carries through for a general initial condition, after a few 
minor modifications: the first line in the definition of the k.(x) processes 
changes and the second line remains the same, 

K n (x) = W*(Xi x ' x+1 ^ - 1) - W*{X^ X -^ - 1), 

so that the important relations (9)-(10) are replaced by an equality up to 
a constant. This does not modify the results in Section 2.2, which only use 
estimates of differences n n +i — K n and Cn+i — Cn- The goal is still to prove 
that K n does not converge to a.s. 
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Lemma 11. For a and e defined above, P({S < 00} U A\Ft k ) > ae/19. 
Proof. Assume that S > ko and let, for n > ko, 

z n :=«t n + y 2 a e (fe )(l K tn-i+il - £ V a <k ) - A tfeo ,oo) , 

where x + = max(a;,0). Then on {n < S}, 

z n+1 -z n = «f n+l - n 2 tn + ^2a e(fco )(|K f „ + i| - E^a e{ko) - A tfcoj00 ) + 

and using (27), it is easy to check that 

2A W n+t \Kt n +i\ < 2A t „,t„ +1 (e v / a^) + A( 00) 
(28) 

+ \J 2a e(k )(\Kt n +l\ "V a <=(fco) - A * fco ,oo) + - 

Due to (28) and Lemma 10, on {ko <n< S}, 

x {o,i}_ 1 A- t {0 '- 1} -l 



E(z n+1 -^J>E £ T^7TW+ E 



Ti, 



^k=xr' i > * ■ k=x 



-2(£ x /a^) + A tfc0iOO )E(A UiWl |^i„). 

A careful reader will note that the definition of stopping time S is designed 
precisely to give the inequality above, that is, to eliminate the auxiliary term 
— 2\Kf -Li I A* t ,. in the drift estimate for k? in Lemma 10. 
Therefore, by uniform integrability, 

E(z s -z ko \F t ) 



v-{<M} 1 v {o,-i} 

E E TF7H2+ E 



Vo, 1} ^) 2 ' ,_^- 1} ^(*0 5 



V fc=xi CM > fe=XJ 



•7^0 



(29) -2(e^a^) + A tfeo , 00 )E(A tfco , too |^ fco ) 

> P({S = 00} n ^l c | J" tfco )a e(feo) - 2(e^o-7^) + £5 e(feo) )E(A tfeo , too \F tkQ ) 

> [P({5 = 00} n A c \F tko ) - (1 - ae)]a e(fco) , 

using, in the third inequality, the fact that e(fco) £ © [cf. (25)], so 

2(eV a e(fco) +^e(fco)) A < fco ,too < 2 ( e V a e(fco) + ^e(fe ))^e(fc ) 

< \/2aea e(fco ) + a 2 a e(fco) 

< a(l + v / 2e)a e (fc ) ^ i 1 ~ a£ ) a e(k ), 
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where the last inequality follows from the definition of e 

2 (n) 



On the other hand, note that (n tn+1 — K tn ) 2 < ^a e i n \ for all n and if 



n G [ko,S) then, 

K t n +i = ( K *n + K t n+1 ~ K tn ) 2 < 2(kI u + 4a e(n) ) 

< 2 f f —j= + e J a e(fco ) + 4a e ( fco) J < 16a e(fco) 

and Kt n+ i < K tn + ^/a^n) < ^t„ + ^/a e (k )- Hence, on {5 < oo}, we have 

zs < (16 + \/2)a e(fco ) < 18a e(fco) , 
on {S = oo}, we have 

( a V 

zs< ( e + — ^ J a e (fc ) < 1 8a e (fc ) 

and on {S 1 = oo} n >4 C , we have 2:5 — 0, so 

(30) E(z s - z k0 \F tkQ ) < 18a e{ko) P({S < oo}UA\F tko ), 

since z ko > 0. 

If we combine (29) with (30) and the two preceding inequalities, we obtain, 
for p:=P({S< oo} U^J, 

18p > 1 — p — (1 — as) = ae — p, 

which implies the lemma. □ 

Now, assume that S < oo and, for instance, Kt s _ 1 +i > £- v /tt e (fc ) + A t k ,oo 
with S > ko, and define the (^i,,) stopping time 

U:=mfln> S:n tn $ ( -y/a^ + A tnj00 ,4^/o^y + A tnj00 J |. 

Remark. The two remaining cases where S happens due to \Kt s \ > 
£ J a e{s) + A iSj00 , can be dealt with in a very similar way. Assuming that 
Kt s > 0, one would redefine 

U:=infln>S:K tn $ ( -^/a^/2 + A tnt00 Ay/a^sj + A t n ,oo) j 

and, in the statement (and proof) of the next lemma, e(ko) would have to be 
replaced by e(S) and ts-i + 1 by ts everywhere, and the estimate Lemma 
9(i) would no longer be needed. 

Note that if U = oo, then it is not the case that both {0, 1} and {0, —1} 
are visited infinitely often, so A happens. 
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Lemma 12. If S > k and K ts _ 1+ i > e^a e ( fco ) + At kQ ,oo, then 
P({U = 00} U {U < 00, K tu > Va^y + A %i00 }|^ ts _ 1+1 ) > e/16. 

Proof. Using Lemma 8(iii) with n G [5, £/), Lemma 9(i) with n = S*— 1, 
and nested expectation, we get 

(31) El Kt v - Kt B _ 1+ i - Yl v k+i\rt s _ 1+ i > 0. 

V k=S-l / 

Now, let us assume that S > ko and Kt s _ 1 +i > e^/a e (fc ) + A ife j00 , and let us 
define 

W := K t(7 - A tc/jOC - (Kts-l+1 ~ A tfe ,oo) < Kt a ~ A tu,oo ~ V a e(fc )' 

Inequality (31) implies, using Lemma 8(h), that 

(32) E(W) = E(Kt v - Kt s _ 1+ i + A tkoitu ) > 0. 

Now, note that on {U < 00, K <Lr < e^/a e (fc )/2 + A t;7i00 }, we have, by defini- 
tion, 

(33) W <K tu - A tl/)0C - e^/a e ( fco ) < -e^/o^j/2. 

On the other hand, on the complement {[/ = 00} U {{7 < 00, n tu > 4^a e (fc ) + 
At^oo} (and in fact on the whole probability space), 

(34) W < Kt v ~ A % ,oo < 7^o^y. 
Indeed, if U = 00, 

by definition of £/, and if C7 < 00, then, using (27), 

K tu ~ ^-tu,oo = Kt V -i ~ ^t-u-1,00 + [Ktu ~ Ktu-i ) 

+ ( A *LT-1,00 - Aty,oo) 

< «fcr-i - A %-i,oo + 3 1 /a e (( 7 _i) < 7^a e(fco ). 
In summary, equations (32), (33) and (34) imply, letting 

P : = P ({U = 00}U{U <CO, Ktu ^ 4 V°e(fco) + A tt7,oo}|^is S _i+l), 

that 

(35) 0<E(W)<-(l-p)e^a^y/2 + 7^a^yp, 
which completes the proof. D 
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Lemma 13. If U <oo and K tu > ^JOi e {u) + A 



tjj,oo> 



then 



P{A\T tu ) >P[ liminf n tn > 0\F tv > 7/16. 
Proof. Define the (J r t n )-adapted process 

in ■= Kt n ~ Y^ V k- 
k<n 

By Lemma 8(iii), (£ n )n>i is a bounded martingale (note that this is not a 
Doob-Meyer decomposition), and hence converges a.s.; this can also be seen 
as a consequence of the convergences of K tn and J2 v^ , being differences of 
nondecreasing bounded sequences. 

Since J2k>u \ v k\ < / ^-t u ,oc by Lemma 8(h), we have 

(36) P( Ktoo = liminf n tn > 0\F tu ) > P(\U - £u\ < ^y/a^U)\^t v ) • 
Now, due to a martingale property of £, 



(37) 



E((£oo-&/)^ % )=E £(4+i-£ fc ) 2 |^ • 

\k=u ) 



To estimate the right-hand side of (37), note that for all k>U, using 

6+i -& = ( K t k+1 - >%+i) + («* fc +i - /%) +v k +i, 

we obtain that 

(6+1 - ikf < 3[(>% +1 - K tfc+ i) 2 + (/ct fc +i - K tk ) 2 + u£ +1 ] 

< 3 [( K * fc+ i - K * fc +i) 2 + («t h +i - K t k ) 2 + A t 2 fcjifc+ J. 
This implies, using identities (20) and (22), and nested expectation, that 



E £(& +1 -& 



\k=U 



Ti 



tu 



(38) 



e ^E(fe + i-e fc ) 2 i^» 

\fc=C7 



•a 



<3E 2 



1 



V I A 2 






•Ftu <9a e ([/). 



Using (37) and (38), together with the Markov inequality, we obtain 



P(\Zoo-Zu\>±^MU)\Ft v )< 



na™ - tuf^tv) ^ 9 



16a 



< 



e(U) 



16' 
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which gives the conclusion, by (36). □ 

The three lemmas above enable us to complete the proof. Indeed, let us 
define t s by t s := t S -i + 1 if S > k and Kt s _ 1+ i > e^/a^j + A tfcoiOC , and 
ts = ts otherwise. Then {S < oo} is Jy -measurable. By Lemmas 12 and 13 
(and the remark preceding Lemma 12), the same argument as in equality 
(26) yields, using {U = oo} C A, that if S < oo, then 

P(A\r t - 8 ) 

= P(U = o\F fg )+K(P(A\r tu )l {u<oo} \F t - 3 ) 

> P(U = oo\F t ~ s ) + ^P(A\^ tv )l {u<00 , Ktu > 4va ^^ +Atift0o} \^ fs ) 

> P({U = oo} U {U < oo, K tu > 4^a^y + & tu ^}\T t ~ s ) > 7e/256. 
Now, this inequality yields, together with Lemma 11, that 

P(^l|^ feo )>E(Ml {5=oo} |^ fco )+E(l {5<oo} P(^|^- s )|^ fco ) 

>P(-4u{S"<oo}|:F tfco ) x 7e/256 > 7ae 2 / 4 864. 

Due to inequality (26) and the Levy 0-1 law, we conclude that Proposition 
6 holds. 
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